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The problem of quantum state inference and the concept of quantum entanglement 
are studied using a non-additive measure in the form of Tsallis' entropy indexed by the 
positive parameter q. The maximum entropy principle associated with this entropy 
along with its thermodynamic interpretation are discussed in detail for the Einstein- 
Podolsky-Rosen pair of two spin- 1/2 particles. Given the data on the Bell-Clauser- 
Home-Shimony-Holt observable, the analytic expression is given for the inferred 
quantum entangled state. It is shown that for q greater than unity, indicating the sub- 
additive feature of the Tsallis entropy, the entangled region is small and enlarges as one 
goes into the super-additive regime where q is less than unity. It is also shown that 
quantum entanglement can be quantified by the generalized KuUback-Leibler entropy. 

PACS numbers: 03.67.-a, 03.65.Bz 

I. INTRODUCTION 

Entanglement is a fundamental concept highlighting non-locality of quantum 
mechanics. It is well known [1] that the Bell inequalities, which any local hidden 
variable theories should satisfy, can be violated by entangled states of a composite 
system described by quantum mechanics. Experimental results [2] suggest that naive 
local realism a la Einstein, Podolsky, and Rosen [3] may not actually hold. Related 
issues arising out of the concept of quantum entanglement are quantum cryptography, 
quantum teleportation, and quantum computation. To give a quantitative measure of this 
concept from various physical and mathematical viewpoints is one of the main thrusts 
of current research in this area. The status of the ongoing research can be found for 
example in a recent report [4]. 

Quantum mechanical description of composite states is given in terms of a 
Hermitian, traceclass, positive semi-definite operator, the density matrix, p. This 
operator replaces the classical probability concepts in addressing the quantum systems 
in terms of a more general probability amplitude framework. The classical information 



theory based on the Shannon entropy measure associated with the classical probability 
has been successful in our understanding of signal processing and communication. 
Classical entanglement of a bivariate probability distribution is understood in terms of 
the mutual entropy which is always positive if the variables are correlated and zero if 
uncorrelated. The quantum counterpart of the entropic measure is the von Neumann 
entropy defined in terms of the density matrix, which incorporates both pure and mixed 
states of a system. It is zero in the case when the state is pure, i.e. = p, and nonzero 
in the case when the state is mixed, i.e. p^ < p, the latter being the most commonly 
occurring feature in practice. Quantum entanglement can occur in both cases. There has 
been ongoing efforts in describing quantitatively the concept of quantum entanglement 
in terms of the von Neumann entropy and its variants, such as the Kullback-Leibler 
entropy. 

Jaynes [5] has pioneered in developing and applying the maximum entropy principle for 
inferring the states of the system be it classical or quantum, with given data as 
constraints. He also pointed out that the Lagrange multipliers needed to specify the 
constraints lend themselves to a "thermodynamic-like" description of the system. In a 
recent paper [6], quantum entanglement has been studied in the context of quantum- 
state inference using the Jaynes maximum entropy principle. In an important special 
example, it was shown that this method yields fake entanglement when only the data on 
the expectation value of the Bell-Clauser-Horne-Shimony-Holt (Bell-CHSH) observable 
[7] is used, in that the density matrix so derived produces apparent entanglement. To 
rectify this, the authors of Ref. [6] suggested that the Jaynes inference scheme be 
supplemented with a procedure of minimization of entanglement. Quite recently, one of 
the present authors [8] suggested a possible cure of this problem by augmenting the data 
with dispersion of the Bell-CHSH observable. It was found that the Jaynes inference 
scheme with this set of two independent data can correctly yield the maximum entropy 
states with true entanglement, which are the intelligent states, that is, states that saturate 
the uncertainty relation between the data on the expectation value and the dispersion. It 
was also shown how, in this example, one may interpret the Lagrange multipliers 
appearing therein, as thermodynamic-like parameters associated with entanglement. 

Much of this type of work involved "additivity" and "concavity" of the above- 
mentioned entropies. For a better understanding of mixed states and even states with 
fractal behavior, another "additive" measure, called the Renyi entropy [9], with a 
parameter a, has often been invoked. This has been used to understand aspects of 
quantum entanglement and inseparability of mixed states [10-12]. However this entropy 
is not convex for all values of the parameter a , specifically for a > 1 . There are also 
theoretical observations [13-15] that the degree of quantum entanglement between 
remote systems (defined in a certain manner) mat be preserved or decreased but cannot 
be increased by local operations on each system. This property analogous to the second 
law of thermodynamics has motivated researchers to investigate thermodynamic-like 
description of quantum entangled states [4, 16-19]. A point that seems to stand out from 
the works [18,19] is that the measure of quantum entanglement may not be additive. 

A generalization of the Jaynes maximum entropy principle along with an attendant 
"thermodynamics" to "non-additive" cases has been proposed and widely discussed in 
the area of non-extensive statistical mechanics. This scheme is based on the Tsallis 
entropy [20]: 



s,[p]=T^(Trp'-i). 



(1) 



where q is greater than zero and describes the degree of non-additivity. In the limit 
q^l, this entropy converges on the von Neumann entropy: 'S'[p] = -Tr(plnp). The 

Tsallis entropy shares many of the common properties of the von Neumann entropy in 
that it is concave for all values of q , unlike the Renyi entropy, obeys the //-theorem, 
etc. The additivity is modified, however. For the product state p*'' ® p*^^', satisfies 
the following relation: 

54p<" (X) p^^)] = 54p<'>] + 54p^^>] + (1 - q)S^[p^^%[p^^^] . (2) 

The cases <q <l and q>l are said to be super-additive and sub-additive, 
respectively. The corresponding generalized maximum entropy principle is based on the 
data given in the form constraints defined as normalized ^-expectation values [21] 

Tr(p^5) 

<B>= \, / (3) 
' Tr(p^) 

and the normalization condition Tr p = 1 . The resulting maximum entropy states are 

found to be never factorized even if the operator B is the sum of two mutually 
commuting observables and consequently correlation is always induced [22]. 
Accordingly, we may surmise that this correlation is linked with quantum entanglement 
produced by the long arm of inseparability. 

The purpose of this paper is therefore to reexamine the example studied in Refs. [6,8] 
within the framework of the principle of maximum Tsallis entropy with two constraints 
as in Ref. [8]. We suggest here that the Tsallis entropy is a valid choice for this purpose 
by virtue of its concavity for all values of the parameter q. Also, unlike the Renyi 
entropy, it has built into it the feature that even if the density matrix is separable, this 
entropy manifests non-additivity of the partial entropies of the individual components, 
while the normalized ^-expectation values defined in eq. (3) remain additive. It seems 
that the long arm of inseparability may be another feature of non-additivity and thus 
lends itself, naturally as an information-theoretic quantity, to investigate the property of 
entanglement mentioned above. Moreover, the maximum entropy principle holds for the 
Tsallis entropy with attendant thermodynamic consequences for describing non-additive 
features. This allows us to examine if indeed one can associate a thermodynamic-like 
description of entangled states using the Tsallis maximum entropy ideas in this context. 
Since this scheme has the features of non-additivity of the entropy but additivity of the 
normalized ^-expectation values [21], it seems to fit a thermodynamic-like description 
of entanglement. Thus it is appropriate to examine this aspect of the theory in the 
present context. 

This paper is organized as follows. In Sec. II, we apply the Tsallis maximum entropy 
principle to statistical inference of entangled quantum states. An analytic solution of this 



procedure is given. In Sec. Ill, we consider the generalized KuUback-Leibler entropy as 
the non-additive measure of quantum entanglement and explicitly calculate it for the 
inferred state obtained in Sec. II. In Sec. IV, we develop generalized thermodynamics of 
the inferred state. Section V is devoted to concluding remarks. 



II. QUANTUM ENTANGLEMENT OF MAXIMUM 
TSALLIS ENTROPY STATES 

As in Refs. [6,8], we consider the Einstein-Podolsky-Rosen pair of two spin-1/2 
particles, A and B , and take the Bell-CHSH observable [7], which is given in terms of 
the Pauli matrices by 

B = V2(a^,®a,, + t7,,®c7^J. (4) 
In the Bell basis [23] 

i*i=i(injn,±i^)j^).). i**>=i(inj^).±i^>.r>J. 

this operator is expressed as follows: 

B = 2a/2 (1 4)^ I - 1 ^" 1) . (6) 
Its ^-expectation value 

<B>, = ^ (7) 
lies in the range 

Q<\<142. (8) 

To apply the principle of maximum Tsallis entropy to statistical inference of quantum 
states, it is necessary to specify a set of the statistical data. As in Ref. [8], in addition to 
the expectation value, we employ its dispersion 

<B'>,= cyl, (9) 

which satisfies 

ol<%. (10) 

The reasons why we include this are that, firstly 



5' =8(|4>^)(4>^| + |^-)(^-|) 



(11) 



is linearly independent of B , secondly this operator obviously commutes with B , and, 
thirdly any measured data on B have to be accompanied with its reliability, a measure 
of which is given by the dispersion. Clearly, a^>b^. On the other hand, the Schwarz 

inequality, <X^ >g<Y^ >q^<^Y>l, with the identification X = B, Y = B^ and the 

observation X = B , Y = 85 , XY = SB, leads to the uncertainty relation 



(12) 



Now, under the two constraints on the data in eqs. (7) and (9) together with the 
normalization condition, maximization of the Tsallis entropy in eq. (1) yields the 
following optimal state 



1 



1 + 



l-q 



\-q 



[x.b+x^b') 



1/(1-?) 



, (13) 



Z^(A„A,) = Tr 



1 + ^(A,Z,,+A,CT„^) 



[x.b+x^b'] 



1/(1-?) 



, (14) 



where /^^ is the unit operator of the composite A B -system and and X2 are the 
Lagrange multipliers associated with the constraints on the data and the quantity is 
defined by 



(15) 



From eqs. (13)-(15), follows a general relation 



l-q 



(16) 



In spite of the fact that the operator appearing in the curly brackets in eq. (13) is nothing 
but the sum of two mutually commuting operators |4>^^^4>^ | and |, the density 

matrix is never factorizable due to its non-exponential form. Thus, correlation is 
induced by non-additivity of the formalism. Such correlation clearly disappears when 
^ — > 1, since in this limit equations (13) and (14) acquire the ordinary exponential form 
obtained from the standard Jaynes scheme. 

To manipulate the density matrix in eq. (13), we use eqs. (6) and (11) as well as the 



completeness relation 



(17) 



and express it in the form 
- _ 1 

PaAB ~ 



x(u„J|4)-V4) 



{a^,o(|^")(^" I + I^^X^^ I) + A^,>^)(^' I + A^..|^")(^" 1} 



1/(1-?) 



(18) 



where 



(19) 



= 1 + ^-^VKK ± 2V2) + A,((7^^ - 8)]. 



(20) 



Since |*^X*1' I* A* I' T /C^ I' T mutually orthogonal 

projection operators, the above density matrix is found to be 



'qAB 



-^[Ko)^->(|.-)(.-H.^)(.1) 



(21) 



and accordingly 



1/(1-?) 



Z,(A,.AJ = 2(/,,„)""-%(,,,_)""-%(^,,)' (22) 

By the same reason, the factor ^ n^^/^^^^^^ is also calculated to be 



1 \r.l \ «/(!-?) / \ «/(!-«) / \ 



ql(.l-q) 



(23) 



Then, from the identical relation in eq. (16), we find another expression for : 

,ql(\-q) I \ql(\-q) ( \q/(l-q) 



^q{KK) = A^qo) 

b^=<B>^ and =< >^ can also be calculated in a similar way: 



(24) 



bq=^^ I 
* 2:^(^1,^2)' 



[^./(.-.)_^./(l-.)]^ 



(25) 



(26) 



We wish to express the elements of the density matrix in terms of the values of the 
data and . For this purpose, some algebraic manipulations are needed. From eq. 
(20), the Lagrange multipliers are found to be 



(27) 



(c7^8)(l-^)l2 



l( b \ 

1- ' 



V 



2V2 



Also, from eqs. (25) and (26), it follows that 



^ b \ 
1 + ^ 
V 2V2, 



-ll/<? 



(29) 



(28) 



Using eqs. (27)-(29) in eq. (19), we have 



1/(1-?) 



\lq 



(30) 



Substitution of eqs. (29) and (30) into eq. (22) leads to 



(<?-l)/9 



= 2 



16 



+ 



16 



\l/9 



+ 



^ C7^^+2V2Z7^ 
16 



,1/? 



(31) 



Therefore we find the following closed expression for the density matrix: 



PqAB 



1 



{q-\)lq 



8-a! 



^a^+2V2^ 
16 



16 ) 



(|4>-)(4)-| + |*^)(^^|) 



4)^/4)+ + 



J 



- 2V2 
16 



(32) 



/ \(«-i)/g 

where \Z\ is given m eq. (31). In the limit q^\, this becomes the density 
matrix given in Ref. [8]. On the other hand, in the limit ^ — > 00, p^^^ becomes reduced 

yv yv 

to (1/4)/^^. This is a product state since /^^ = /^®/^, where (7^) is the unit 
operator in the space of the spin A {B). 



The separability condition given in Ref. [12] states that the eigenvalues of the density 
matrix do not exceed 1/2. That is, it is sufficient for realizing entanglement if the 
largest eigenvalue obeys the condition 



g;+2A/2Z7^ 

9-1 



16^) 



(33) 



This equation tells how quantum entanglement is induced simultaneously by the 
maximum entropy principle and non-additivity of the Tsallis entropy. In Fig. 1, the 
condition in eq. (33) is depicted for some values of q. The entangled region is shown as 
the "island" above the "sea level" z = l/2. It is interesting to observe that q>\, 
indicating the sub-additive feature of the Tsallis entropy, the entangled region is small 
and enlarges as we go into the super-additive regime where q<\. 

Closing this section we wish to note that the intelligent state, which saturates the 
uncertainty relation in eq. (12), does not have the element of Moreover, if 

=2V2 (i.e., = 8), then we see the purification of the state: pJ7b = 

which is a maximally entangled state. This point will be revisited in Sec. IV from the 
thermodynamic viewpoint. 



III. GENERALIZED KULLBACK-LEIBLER MEASURE OF 
QUANTUM ENTANGLEMENT 

To quantitatively describe the concept of quantum entanglement, the entropic 
measures such as the von Neumann, KuUback-Leibler, and Renyi entropies have been 
investigated in the literature [11-15]. These measures are additive under replication (or, 
multi-plication) of the system. As discussed in Refs. [18,19], however, a measure of 
quantum entanglement may not be additive, in general. What is more essential is the 
convergence of the "thermodynamic limit", in which the system degrees of freedom 
become arbitrarily large. The non-additive approach we have developed in the 
preceding section is based on non-extensive Tsallis statistical mechanics, which is 
known to lead to a consistent thermodynamic framework. In this section, we consider as 
a non-additive measure of quantum entanglement the generalized KuUback-Leibler 
(KL) entropy associated with the Tsallis entropy and calculate its value for the inferred 
entangled state given in Sec. II. 

The generalized KL entropy of p with respect to the reference state p' is defined by 

which is the quantum mechanical generalization of the classical definition given in 
Refs. [24]. (See also Ref. [25].) This quantity is positive semi-definite and is equal to 



zero if and only if p = p'.lt measures the difference between p and p' . The parameter 
q' is taken differently from q of the Tsallis entropy for the sake of generality. In the 
limit >1, the generalized KL entropy becomes the ordinary KL entropy: 
K^{p,p']^ Tr[p(lnp-lnp')]. 

Consider the marginal density matrices of the inferred density matrix p^^g, which 
are defined as follows: 



PqA ^^sPqAB' 



PqB ^^APqAB' 



(35) 



where the symbol Tr^ ( Tr^) stands for the partial trace over the states of the spin A 
(B). The state is unentangled if the total density matrix is the product of the marginal 
density matrices. Therefore the generalized KL entropy ^^-[p^ab' P<?a ® P^b]' which is 
referred to as the generalized mutual entropy, measures the degree of entanglement in 
the state P^ab- Note that it is invariant under the local unitary transformation: P^ab^ 

Uj^®UgP^Aj^U\®U\. (Though the generalized conditional entropies might also be 

considered for discussing the information content given the marginal density matrices, 
the generalized mutual entropy considered here seems to offer the most suitable 
measure.) In the special example considered here, we have 



Trj4)*)(4>^ 



:Tr^^I'-)(^- 



(36) 



Tr>^W 



Tr,|^^)(^^| = i/,. 



(37) 



Using these equations in eq. (32), we find the following marginal density matrices: 



PqA 2^^' 



(38) 
(39) 



PqB ~ 2^^' 

Notably, these are independent of both the data on the Bell-CHSH observable and the 
parameter q . Thus we obtain 



PqA®PqB=YlAB- 



(40) 



Now, the generalized mutual entropy can immediately be calculated. The result is 

K,{P,AB' PqA®P,B] 



1-q' 



1-fel 



q'(l-q)/q 



2(1-9') 



8-C7 

16 



2 \ 



+ 



16 



+ 



16 



(41) 



where is given in eq. (31). In the particular case of the intelligent pure state 
pP'^l = \c^+'j(c^^\ corresponding to C7^=2V2&^ and &^=2a/2, equation (41) is 
simplified to 



1 



1- 



1 



(42) 



which is independent of q and, in the limit ^' — > 1, converges on the value 2 In 2. We 
can find from eq. (41) that quantum entanglement in the super- additive and sub-additive 
regimes is quantified by the positive semi-definite K^,, in conjunction with the results 

exhibited in Fig. 1. 



rV. GENERALIZED THERMODYNAMICS OF THE INFERRED 
STATE 

The discussion in Sec. II is suitable for thermodynamic consideration of the inferred 
quantum entangled state since it is developed in conformity with non-extensive Tsallis 
statistical mechanics. In this section, we present the thermodynamic Legendre transform 
structure and some equilibrium thermodynamic quantities constructed from the inferred 
state. 

First of all, let us see that the state in eq. (32) is in fact the maximum Tsallis entropy 
state. The Tsallis entropy of this state is given by 



where the identical relation in eq. (16) has been used. Taking the derivatives of this 
entropy with respect to the Lagrange multipliers and and using eqs. (19), (20), 
(23)-(26), we can explicitly ascertain the maximum Tsallis entropy condition 





(43) 



= 0. 



(44) 



We now note that the following relations hold for the Lagrange multipliers: 



db 



— ^i. 



Bel 



(45) 



These relations allow us to formally define the "free energy" 



(46) 



where 



(47) 



From this, we obtain 



(9 A, 



(48) 



conversely. These steps establish the Legendre transform structure promised earlier. 

It is also of interest to examine the limits ^1,^2— >°o. These limits essentially 
correspond to the "zero temperature limit", in which the Tsallis entropy in eq. (47) 
should vanish, that is, ^1. Now, from eq. (31), we see that this condition is 

equivalent to 



(49) 



which lead to, as expected, the purification of the state: p^^^ — > |^ )(^ 



V. CONCLUDING REMARKS 

We have studied in an example of two correlated spins the problem of quantum state 
inference using a non-additive measure in the form of Tsallis' entropy and have 
presented the analytic solution for the density matrix. By analyzing the condition of 
entanglement and the positive semi-definiteness of the generalized KuUback-Leibler 
entropy, the super- and sub-additive regimes of quantum entanglement have been 
elucidated. We have thus shown how quantum entanglement is induced by the principle 
of maximum Tsallis entropy with the data on the Bell-CHSH observable and have 
quantified the degree of entanglement by means of the generalized KuUback-Leibler 
entropy. We have found that strong non-additivity enhances entanglement in the super- 



additive case. We have also given a thermodynamic interpretation to the inferred 
quantum entangled state. 

The present approach based on non-extensive Tsallis statistical mechanics has an 
attractive feature. The generalized "internal energy" defined by the normalized q- 
expectation value of the Bell-CHSH observable regarded as the "Hamiltonian" satisfies 
additivity [21], whereas the generalized "free energy" is non-additive. This feature has a 
parallelism with an intriguing analogy between measures of entanglement and 
thermodynamic quantities pointed out in Ref. [19]. 
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Figure caption 



Fig. 1 The plots of the condition in eq.(33) in the domain |0 < < 2a/2, (7^ < Sj : 



The plane z=l/2 and z = 



(CT,^+2V2&,)/16(Z,) 



with 



(Jl>2-^^2b^ for(a)q=5, (b) q=2, (c) q=1.5, (d) q=0.9, (e) q=0.5, 
(f)q=0.1. 
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